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We present measurements of _B-meson decays to the final states rj' p, rj'fo, and rj'K* , where K* 
stands for a vector, scalar, or tensor strange meson. We observe a significant signal or evidence 
for ^-nd E'll the ri'K* channels. We also measure, where applicable, the charge asymmetries, 

finding results consistent with no direct CP violation in all cases. The measurements are performed 
on a data sample consisting of 467 x 10^ BB pairs, collected with the BABAR detector at the PEP- 
II e'^e~ collider at the SLAC National Accelerator Laboratory. Our results favor the theoretical 
predictions from perturbative QCD and QCD Factorization and we observe an enhancement of the 
tensor K2 (14:30) with respect to the vector A"* (892) component. 



PACS numbers: 13.25.Hw, 12.15.Hh, ll.30.Er 

Charmless two-body decays of B mesons are a pow- 
erful probe for testing the standard model (SM) and 
searching for new physics phenomena [ij. Decays to fi- 
nal states containing rj or rj' mesons exhibit a distinctive 
pattern of interference among the dominant amplitudes 



and are also sensitive to a potentially large flavor-singlet 
contribution B meson decays to the final states 

rj' p and rj'K* [892) have been investigated theoretically 
within the SM by means of perturbative QCD (pQCD) 
[3], QCD Factorization (QCDF) 4], Soft CoUinear Ef- 
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fective Theory (SCET) [sl, and SU{3) flavor symmetry 
0. The predicted branching fractions to the final states 
r]'K* (892)+ and 77'-^* (892)° are in the range of a few 
times 10~^, whereas the branching fraction for — >■ rj'p^ 
is suppressed to 10~^ — 10~^. There is some disagree- 
ment on the predictions of the branching fraction for 
B+ ->ri'p+: SCET calculations give a value of 0.4 xlO-^ 
whereas pQCD and QCDF predict a branching fraction 
of (6 — 9) X 10^®. There are no theoretical predictions 
for the branching fraction of — > rj' fo. 

Experimentally, searches for these decays have been 
performed by the EaBAR 0] and Belle Q collaborations. 
The former claimed evidence for the rj'p^, r]'K*{892)^, 
and rj' K* {892)^ final states, while the latter establishes 
upper limits that are in poor agreement with the branch- 
ing fractions, in the range (4 — 9) x 10~^, measured by 

babar. 

Very few predictions exist for B-meson decays to 
(1430) and ?7'ir|(1430). In Ref. Q, based on pQCD, 
the branching fraction of _B — )■ ij' Kq{1A30) is predicted 
to be in the range (20 - 80) x 10"^, while in Ref. [Ifl] 
the branching fraction of _B 77'_fi'|(1430) is calculated 
to be ~ 2 X 10~^, exploiting QCDF calculations. No 
searches for the r]'K^{U50) and r/'ii'|(1430) final states 
have been reported. In a recent study of _B — !■ uK* de- 
cays JTl|, where K* denotes the spin 0, 1, or 2 states 
K^{U30), if* (892), and if2*(1430), the tensor and scalar 
K* components were found to be significantly larger than 
the vector if* (892), a fact which was not anticipated by 
theory. 

In this paper, we report measurements of the branching 
fractions of B mesons decaying to the final states rj'p, 
rj'fo, and rj'K*. Where applicable, we also measure the 
charge asymmetry Ach = (E^ — F+)/(F^ + F+), where 
the superscript to the decay width E refers to the charge 
of the B^ meson or to the charge of the kaon in the 
neutral B decays. 

For this analysis we use the full BaBar dataset, col- 
lected at the PEP-II asymmetric-energy e+e" collider 
located at the SLAC National Accelerator Laboratory, 
consisting of 467 x 10^ BB pairs originating from the 
decay of the T{AS) resonance, produced at a center-of- 
mass (CM) energy y/s = 10.58 GeV. The BaBAR detector 
is described in detail elsewhere 
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We reconstruct i3-daughter candidates through their 
decays 77' rjir+Tr- (77',^^), r?' p°i iv'p-ylr] -> 77, 



p' ^ TT ' TfO. ^ TT+TT-, /o(980) TT+TT" [13l , 



K+ 



TT 



K* 



ifO^TT 



K" 



TT^, and 7r° — > 77. We use both 77' 
and 77' — > p°7 for rj'K* , but due to the larger backgrounds 
affecting the 7;^^ channel, we do not use the 77' — >■ p^j de- 
cay mode for the ?7'p and rj' fo final states. We require the 
invariant masses of the i?-daughter candidates to satisfy 
the following requirements: 910 < ra{ri') < 1000 MeV, 
510 < 771(77) < 580 MeV, 510 < m(p//o) < 1060 MeV, 



750 < 77i(ii'*) < 1550 MeV, 488 < 77i(if0) < 508 MeV, 
and 120 < m{Tr°) < 150 MeV; these mass intervals are 
chosen to include sidebands to estimate the background 
levels. We require the photon energy of the tt° candidates 
to be greater than 30 MeV in the laboratory frame, while 
the minimum energy is 100 MeV for the photons of 77 can- 
didates and 200 MeV for the photons from the 77' — >■ /9°7 
decay. A fit constraining the two pion tracks from the 
ifg decay to originate from the same decay vertex is per- 
formed and a ifg candidate is selected if its flight length 
exceeds three times its uncertainty. Daughter particles 
from 7/, 7], p, fo, and K* decays are rejected if their par- 
ticle identification signatures are consistent with those 
of electrons or protons; candidates are required to 
be positively identified as kaons, and pions must fail this 
criterion. Unless otherwise stated, charge-conjugate re- 
actions are always implied. 

A i3-meson candidate is characterized by two kine- 
matic variables, whose small correlation is accounted 
for in the correction of the fit bias: the energy substi- 
tuted mass TTiES = \/s/4 — p-^ and the energy difference 
AE = Eb — •\/s/2, where {Eb,Pb) is the i?-meson four- 
momentum vector in the T(45') rest frame. Signal events 
peak at in AE and at the B mass in 7?zes, with a 
resolution in AE {mEs) of 20-35 MeV (3 MeV). We se- 
lect events with 5.25 < 771es < 5.29 GeV and |A£:| < 0.2 
GeV. 

The dominant backgrounds arise from random com- 



qq events 



binations of particles in continuum e e~ 
(q — u, d, s, c). The angle 9t between the thrust axis |15 | 
of the B candidate in the T{AS) rest frame and that of the 
remaining particles in the event is used to suppress this 
background. Jet- like continuum events peak at | cos 9t \ 
close to 1, while spherical B decays exhibit a flat distri- 
bution for this variable. Further rejection is achieved by 
restricting the range of the helicity angle of the p or K* 
meson. The helicity angle 9-u is defined in the rest frame 
of the p or K* and corresponds to the angle between two 
vectors: one is the momentum of the daughter pion and 
the other is the direction of the boost into this rest frame 
from the B meson rest frame; for the p"*" candidate we 
use the positively charged pion. Table U summarizes the 
requirements we apply on | cos 0^1 and cos^-^- After the 
selection criteria have been applied, the average number 
of combinations per event in data is between 1.1 and 1.3, 
and we select the candidate with the highest proba- 
bility in a geometric fit to a common i3-decay vertex. In 
this way the probability of selecting the correctly recon- 
structed event is a few percent higher with respect to a 
random selection. 

Further signal/background separation is provided by 
a Fisher discriminant T exploiting four variables sensi- 
tive to the production dynamics and event shape: the 
polar angles, with respect to the beam axis in the e+e^ 
CM frame, of the B candidate momentum and of the B 
thrust axis; and the zeroth and second angular moments 
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TABLE I: Selection requirements on cos 6t and cos On for 
the different modes. 



State 


1 cos 6t I 


cos On range 


v'pVfo 


< 0.9 


[-0.95,0.95] 




< 0.9 


[-0.80, 1] 



VrfTTTT 


< 0.9 


[-0.85, 1] 


n' K** 


< 0.6 


[-0.85, 1] 


< 0.9 


[-0.75, 1] 


< 0.7 


[-0.75, 1] 


W K*+ 

'IpI-'^K+tt" 


< 0.9 


[-0.90, 1] 


< 0.7 


[-0.90, 1] 



Lo,2 of the energy flow, excluding the B candidate. The 
moments are defined by Lj = J2iPi ^ |cos6'i|"' , where 
i labels a track or neutral cluster, 6i is its angle with 
respect to the B thrust axis, and pi is its momentum. 
The mean of is shifted so that it is independent of the 
i?-flavor tagging category [l^ for qq background. The 
Fisher variable provides about one standard deviation 
discrimination between _B-decay events and continuum 
background. 

We obtain the yields and the charge asymmetries Ach 
from extended maximum-likelihood (ML) fits to the six 
observables: AE, mEs, J^, the masses of the two reso- 
nance candidates m^/ and rripj j^j^^,^ and cos0-u. The 
fits distinguish among several categories: qq background, 
BB background, and signal component(s) (one for rj'p^, 
two for rj'p'^ / fo, and three for the r]'K* modes). For each 
event i and category j we define the probability density 
functions (PDFs) Vjix) for the variable x, with the re- 
sulting likelihood C: 



C 



(1) 



(2) 



i=l j 



where Y) is the yield for category j and N is the num- 
ber of events entering the fit. Where applicable, we 
split the yields by the flavor of the decaying B meson 
in order to measure Ach- We find correlations among 
the observables to be significant in the BB components, 
whereas those are small in the data samples, which con- 
tain mostly qq background. An exception occurs in the 
5+ — >■ rj'p^K*j^j^^o mode, for which the correlation be- 
tween rriK* and cos^-h, if not taken into account, may 
cause large biases in the yield of the different K* compo- 
nents. In this case the factors for m^. and cos in Eq.[T] 
are replaced with a two-dimensional non-parametric PDF 
17| . We discuss below our treatment of the somewhat 
larger correlations found in simulated signal events. 



The signal component is studied from the Monte Carlo 
(MC) simulation [18[ of the decay process and the re- 
sponse of the detector and reconstruction chain. Signal 
events selected in simulation contain both properly re- 
constructed and incorrectly reconstructed i?-meson can- 
didates, which are labeled as " self-crossfeed" (SXF). SXF 
occurs either when some particles from the correct par- 
ent B meson are incorrectly assigned to intermediate res- 
onances or when particles from the rest of the event are 
used in the signal B reconstruction. The fraction of SXF 
events ranges between 14% and 32% and we do not sep- 
arate correctly reconstructed events from SXF in the fit. 
For the scalar K-k component, we use the LASS model 
[iqI [2o1 |. which consists of the ifg(1430) resonance to- 
gether with an effective-range nonresonant component. 
Backgrounds arising from BB decays to charmless final 
states are modeled from the simulation. We select the 
channels (20-40 for each final state) which have a high 
probability of passing our selection and build a sample of 
simulated specimens of these, weighting each component 
by its branching fraction, either measured or estimated. 
We model from this sample the PDFs for the BB back- 
ground component and fix its yield (25-350 events, de- 
pending on the final state) to the MC prediction. Back- 
grounds arising from & — ^ c transitions have distribu- 
tions very similar to those of qq events and thus they 
are absorbed by the continuum component. For the -q' p 
modes, we estimate the contribution of the nonresonant 
■q'TTTT with a fit of the data, selecting only the central 
region (which excludes the region across the p and /o 
resonances) of the rj'-m: Dalitz plot. The expected non- 
resonant component is then included in the charmless 
BB background PDF. This procedure is not necessary 
for the rj' K* fits, since the nonresonant -q' K-k component 
is already included in the LASS model. 

PDF shapes for the signals and BB background are 
determined from fits to MC samples, while for the qq 
component we use data sidebands, which we obtain ex- 
cluding the signal region 5.27 < mEs < 5.29 GeV and 
\/:\E\ < 0.075 GeV. The calibration of niES and AE 
is checked by means of large data control samples of 
B decays to charmed mesons with topology similar to 
the decays under study (e.g. _B+ D'^ {K'^n^ ir'^jir'^ , 

B+ W[K+TT-TT°)p+). 

We use a combination of Gaussian, exponential, and 
polyiromial functions to parameterize most of the PDFs. 
For the mEs distribution of the qq background compo- 
nent, we use a parameterization motivated by phase- 
The following are free to vary 
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space arguments 
in the fit: the signal and qq background yields and 
charge asymmetries Act^ along with the parameters that 
most strongly infiuence the shape of the continuum back- 
ground. 

We perform fits to ensembles of simulated experiments 
in order to evaluate the potential bias Iq on the fitted sig- 
nal yield, which originates from our neglect of the correla- 
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mjjs (GeV) m^,^ (GeV) 



FIG. 1: B-candidate thes projections for (a) rj' p'' / rj' fo , (b) 
ry'p"*", (c) rj'K*", (d) r]' K""^ . Color online: the solid curve 
is the fit function, black long-dash-dotted is the total back- 
ground, and the blue dashed curve is the total signal contribu- 
tion. In (a) we separate the p° component (red dashed) from 
the /o (green dotted). In (c,d) we separate the K*{892) (red 
dashed), the {Ktt)q (green dotted), and J('2(1430) (magenta 
dot-dashed) components. 



tions among the variables. Each such experiment has the 
same number of signal and background candidates as the 
data; given that correlations among fit variables are neg- 
ligible for qq events, these are generated from the PDFs, 
while signal and BB background events are taken from 
fully simulated MC samples. In computing the branching 
fraction B for each mode, we subtract Yq from the fitted 
signal yield Y and divide by the selection efficiency e for 
signal events, the number of B mesons in our sample, and 
the product of the branching fractions of the intermedi- 
ate resonances, Yi^i- We assume the branching fraction 
of T(45') to B+B~ and B°B° to be the same and equal 
to 50%, consistent with the measurements [l^. The effi- 
ciency e is evaluated from the simulation. 

The different submodes of rj'K*^ and rj' K*'^ are com- 
bined by adding their — 21n£ curves. For the signifi- 
cance of observation S we take the difference between 
the value of —2 In £ for the zero signal hypothesis and the 
value at its minimum. For modes with a significance be- 
low five standard deviations, we quote a 90% confidence 
level (C.L.) upper limit, corresponding to the branching 
fraction below which lies 90% of the total of the likeli- 
hood integral, in the region where the branching fraction 
is positive. The correlated and uncorrelated systematic 
uncertainties are taken into account in the above eval- 



uations by convolving the likelihood function given by 
the fitter with a Gaussian function representing the sys- 
tematic uncertainties. The results are collected in Table 

IE 

We show in Fig. [T]the data and the fit functions pro- 
jected over the variable mES, while in Fig. [2] we do the 
same for the tttt and Kir invariant masses and for cos 6-u. 
In these plots the signals are enhanced by the imposition 
of cuts on ln£ and the fit variables, which retain 40-65% 
of the signal events. 

We evaluate the systematic uncertainties due to the 
modeling of the signal PDFs by varying the relevant pa- 
rameters by their uncertainty, derived from the consis- 
tency of fits to the above mentioned data control sam- 
ples. The fit bias arises mostly from correlations among 
the fit variables, which are modeled by the MC; the as- 
sociated uncertainty is the sum in quadrature of half the 
correction itself and its statistical uncertainty; this is the 
dominant source in most cases (2.1 - 15.4 events), es- 
pecially for the ri' — )■ p'^^ modes. We verify that the 
correlations among the variables in SXF events are the 
major source of bias by performing a dedicated study on 
simulated experiments in which the SXF component is 
not embedded. The uncertainty for the SXF fraction is 
estimated by varying the fraction predicted by the MC 
by 2.5% (5%) relative for each photon (7r°) in the final 
state (most of this uncertainty originates from the simu- 
lation of neutral particles) . We estimate the uncertainty 
on the charmless BB background by repeating the fit 
with the yield of this component varied by its estimated 
uncertainty (±20%). For the 5'- wave Kir components, 
we vary the LASS parameters by the uncertainties found 
in [l^ (the resulting uncertainties vary from 0.1 to 14.9 
events). 

Multiplicative systematic uncertainties (which do not 
affect the signal significance) account for imperfect 
knowledge of the luminosity, tracking efficiency, tt*^ and 
A'g reconstruction efficiencies, and the uncertainty on the 
measured branching fractions of intermediate resonances. 
In the nominal fit we do not account for interference 
among the different spin K* components. We estimate in 
a separate calculation, which takes into account the ac- 
ceptance functions of our analysis, the potential impact 
of interference when the relative strong phases between 
the components are varied over the full range; we find 
that the uncertainties range from 1.5% to 14.1%. 

From the analysis of a variety of data control samples, 
the bias on is found to be negligible for pions and 
-0.01 for kaons, due to differences of and K~ interac- 
tions in the detector material. We correct the fitted Ach 
by -1-0.01 in the modes where a charged kaon is present 
and assign a systematic uncertainty of 0.02, mainly due 
to the bias correction. 

In conclusion, we have measured the branching frac- 
tion of B mesons to nine different final states; we claim 
observation of four of these, while we obtain robust ev- 
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FIG. 2: Top row: B-candidate m^-^ projections for (a) Vi' fP /ri' f^, (b) ^-nd mx-Tr for (c) rj'K*'^, (d) rj' K*'^; on the bottom 

row we plot the cosine of the hehcity angle Ou for (e) rj' /ri' fo, (f) r/'p"*", (g) r]' K*^ , and (h) rj' K*'^ . Color online: the solid curve 
is the fit function, black long-dash-dotted is the total background, and the blue dashed curve is the total signal contribution. 
In (a) we separate the p° component (red dashed) from the /o (green dotted). In (c,d) we separate the K*{892) (red dashed), 
the {KTr)Q (green dotted), and ifj(1430) (magenta dot-dashed) components. 



idence for several others. We compute the branching 
fraction for Ty'ifg (1430) using the composition of (Kir)^ 
from [20]. We find B{B° 77'X*(1430)°)=(6.3 ± 1.3 ± 
0.5±0.7) X 10-6 and B{B+ rj' K^{U30)+):^{5.2±1.9± 
0.8 ± 0.6) X IQ-^, where the third error comes from the 
uncertainty in the ^0(1430) — > Kit branching fraction 
No significant direct CP- violation is seen in the in- 
vestigated channels. Our results are consistent with and 
supersede those reported in [7] . Our measured branching 
fraction for — )■ rj'p^ favors the predictions based on 
pQCD and QCDF over those based on SCET. As in the 
B — > ujK* case, we observe an enhancement of the ten- 
sor ^^2(1430) over the vector i^*(892); this has not been 
anticipated by the theoretical calculations. 
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Y 

(events) 


Yo 
(events) 


e 
(%) 


Il'3^ 

(%) 


S 

{^) 


B 

(10- 




B U.L. 

(io-«) 


Ah 




37±15 


9±5 


23.4 


17.5 


2.0 


1.5 ±0.8 ±0.3 


2.8 


- 




8±8 


4±2 


25.9 


17.5 


0.5 


2+°* 
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0.9 




r,'p+ 


128±22 


15±8 


14.3 


17.5 


5.8 


9.7+^i 


± 1.1 


- 


0.26 ±0.17 ±0.02 


rj'K* {892f 


28±10 
61±18 


4±2 
9±5 


18.9 
13.3 


11.7 
19.6 


4.0 
2.7 
3.1 


1 +0.9 
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± 1.0 




-0.19 ±0.17 ±0.02 
-0.39 ± 0.20 
0.32 ±0.31 













2.9 


e.otlo ±0.9 


9.3 


0.06 ±0.20 ±0.02 




36±15 


2±1 


13.9 


5.8 


2.4 


8.8^3.8 ± 1.3 




0.00 ±0.41 




185±51 


31±15 


12.8 


9.8 


2.8 


26.41^;° ± 5.9 




0.23 ±0.27 


'?77 7r7r (-^sTT )o 


18±12 


1±1 


18.6 


4.0 


1.6 


5.1+^-^ ±0.9 




0.13 ±0.59 


^;,(7^07r+)S+ 


-29±22 


-8±4 


17.4 


6.8 




-3.8+Yl ± 1.5 




-0.40 ± 1.48 



77'A'2*(1430)" 5.3 
ry;^^A'2*(1430)'' 42±13 2±1 15.1 5.8 3.7 
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